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Abstract of JP 2000253351 (A) 

PROBLEM TO BE SOLVED: To avoid preparing the summarized image of one-sided 
contents and to securely prepare a summarized image of high flexibility according to a 
purpose, by sorting a scene based on a priority set by priority setting means and optionally 
set output priority. SOLUTION: A moving image is read through an animation inputting means 
1 from a hard disk. Concerning the read moving image. A scene dividing means 3 
automatically or manually detects a cut varying point of the switching of a camera, etc., and 
stores information on obtained cut varying point as scene dividing data. Next, a grouping 
means 5 groups the scene in accordance with the contents of animation and the priority 
setting means 7 sets the priority of the scene based on a grouped result.; A summary output 
means 9 prepares a summary by sorting the scene in accordance with the priority set to each 
scene through the use of the designated priority degree. 
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(54) [Title of the Invention] 

MOVING IMAGE DIGEST APPARATUS, COMPUTER- READABLE RECORDING 
MEDIUM RECORDING A MOVING IMAGE DIGEST GENERATING PROGRAM, 
MOVING IMAGE REPRODUCING APPARATUS, AND COMPUTER- READABLE 
RECORDING MEDIUM RECORDING A MOVING IMAGE REPRODUCING PROGRAM 

(57) [Abstract] 
[Problem to be solved] 

To provide a moving image digest apparatus which facilitates 
scene selection by setting incremental priorities to scenes 
resulted from image segmentation, in generating a digest of a 
moving image . 
[Solution] 

Provided are a moving image input means 1 for inputting and 
storing a moving image; an scene segmentation means 3 for 
segmenting the moving image input by the moving image input 
means 1 for each scene; a group generation means 5 for grouping 
the scenes resulted from the segmentation by the scene 
segmentation means 3; a priority setting means 7 for setting a 
priority to a scene based on the result of the grouping by the 
group generation means 5; and a digest output means 9 for 
cutting out parts from a moving image stored in the moving image 
input means 1 according to a priority set by the priority 
setting means 7, combining the parts and outputting the result 
as a digest moving image. 



[Claims for the Patent] 
[Claim 1] 

A moving image digest apparatus characterized by comprising: 

a moving image input means for inputting a moving image; 

an scene segmentation means for segmenting the moving image 
input by said moving image input means for each scene; 

a group generation means for grouping the scenes resulting 
from the segmentation by said scene segmentation means; 

a priority setting means for setting a priority of the scene 
based on the result of grouping by said group generation means; 
and 

a digest output means for generating a digest moving image 
by selecting the scenes based on priority information set by 
said priority setting means and optionally-set output priority. 
[Claim 2] 

The moving image digest apparatus according to claim 1, 
characterized in that said priority setting means sets the 
highest priority to the first scene of the group. 
[Claim 3] 

The moving image digest apparatus according to claim 1 or 2, 
characterized in that said group generation means comprises: 

a title determining means for determining whether title text 
is included in an image in the vicinity of the beginning 
position of a scene or not; 

a topic switch point setting means for setting a scene 
segmentation point which is determined to include the title text 
from the result of said title determining means as a topic 
switch point; and 
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an automatic grouping means for grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
{Claim 4] 

The moving image digest apparatus according to claim 1 or 2, 
characterized in that said group generation means comprises: 

an audio feature detection means for detecting an audio 
feature in the vicinity of a scene segmentation point; 

a topic switch point setting means for setting a scene 
segmentation point which is determined to include the audio 
feature from the result of the audio feature detection means as 
a topic switch point; and 

an automatic grouping means for grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
[Claim 5] 

The moving image digest apparatus according to claim 1 or 2, 
characterized in that said group generation means includes: 

a title determining means for determining whether title text 
is included in an image in the vicinity of the beginning 
position of a scene or not; 

an audio feature detection means for detecting an audio 
feature in the vicinity of a scene segmentation point; 

a topic switch point setting means for setting a scene 
segmentation point which is determined to include the title text 
by said title determining means and also determined to include 
the audio feature by said audio feature detection means as a 
topic switch point; and 
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an automatic grouping means for grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
[Claim 6] 

The moving image digest apparatus according to claim 4 or 5, 
characterized in that said audio feature detection means detects 
an audio fade-in. 
[Claim 7] 

The moving image digest apparatus according to claim 4 or 5, 
characterized in that said audio feature detection means detects 
a sudden increase in the audio level. 
[Claim 8] 

The moving image digest apparatus according to any one of 
claims 1 to 7, characterized in that said priority setting means 
comprises : 

a beginning position setting means for setting a position in 
a scene to be a beginning point of a part adopted as a digest; 
and 

a continuous section setting means for setting a duration 
time period from the beginning position. 
[Claim 9] 

The moving image digest apparatus according to any one of 
claims 1 to 8, characterized by further comprising a set 
information output means for structuring and outputting a result 
of associating pointer information to the moving image input by 
said moving image input means and priority information set by 
said priority setting means with scene information stored by 
said scene segmentation means. 
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[Claim 10] 

A moving image reproducing apparatus characterized by 
comprising : 

a set value reading means for reading set information set by 
said set information output means of the moving image digest 
apparatus according to claim 9; 

a moving-image-to-reproduce input means for reading a moving 
image based on pointer information to the moving image described 
in the set information; 

a priority-to-reproduce setting means for setting a priority 
of scene of interest to reproduce; and 

a digest reproducing means for reproducing a digest based on 
priority information read, the moving image, and the reproducing 
priority set by said priority-to-reproduce setting means. 
[Claim 11] 

The moving image digest apparatus according to claim 9, 
characterized in that said set information output means 
comprises: a reproducing limitation priority setting means for 
setting the minimum value of priority that is allowed to be 
reproduced; and a minimum priority unlock key setting means for 
setting a key for unlocking the minimum priority. 
[Claim 12] 

A moving image reproducing apparatus characterized by 
comprising : 

a set value reading means for reading set information set by 
said set information output means of the moving image digest 
apparatus according to claim 11; 



a moving-image-to-reproduce input means for reading a moving 
image based on pointer information to the moving image described 
in the set information; 

a limited reproducing priority setting means for setting a 
priority of a scene of interest to reproduce unable to be set 
equal to or lower than the reproducing limitation priority set 
by said reproducing limitation priority setting means of the 
moving image digest apparatus according to claim 11; 

a limit unlocking means for unlocking the limit on the 
reproducing limitation priority by specifying the minimum 
priority unlock key set by said minimum priority unlock key 
setting means of the moving image digest apparatus according to 
claim 11; and 

a digest reproducing means for reproducing a digest based on 
priority information read, the moving image, the limited 
reproducing priority setting means, and the reproducing priority 
set . 

[Claim 13] 

A computer-readable recording medium recording a program for 
causing a computer to execute: 

a moving image input step of inputting a moving image; 

an image segmentation step of segmenting the moving image 
input in said moving image input step for each scene; 

a group generation step of grouping the scenes resulting 
from the segmentation in said image segmentation step; 

a priority setting step of setting a priority of the scene 
based on the result of grouping in said group generation step; 
and 
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a digest output step of generating a digest moving image by 
selecting the scenes based on priority information set in said 
priority setting step and optionally-set output priority. 
[Claim 14] 

The computer-readable recording medium according to claim 13, 
characterized in that said priority setting step sets the 
highest priority to the first scene of the group. 
[Claim 15] 

The computer-readable recording medium according to claim 13 
or 14, characterized in that said group generation step 
comprises : 

a title determining step of determining whether title text 
is included in an image in the vicinity of the beginning 
position of a scene or not; 

a topic switch point setting step of setting a scene 
segmentation point which is determined to include the title text 
from the result of said title determining step as a topic switch 
point; and 

an automatic grouping step of grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 

[Claim 16] 

The computer-readable recording medium according to claim 13 
or 14, characterized in that said group generation step 
comprises : 

an audio feature detection step of detecting an audio 
feature in the vicinity of a scene segmentation point; 



a topic switch point setting step of setting a scene 
segmentation point which is determined to include the audio 
feature from the result of said audio feature detection step as 
a topic switch point; and 

an automatic grouping step of grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
[Claim 17] 

The computer-readable recording medium according to claim 13 
or 14, characterized in that said group generation step 
includes : 

a title determining step of determining whether title text 
is included in an image in the vicinity of the beginning 
position of a scene or not; 

an audio feature detection step of detecting an audio 
feature in the vicinity of a scene segmentation point; 

a topic switch point setting step of setting a scene 
segmentation point which is determined to include the title text 
in said title determining step and also determined to include 
the audio feature in said audio feature detection step as a 
topic switch point; and 

an automatic grouping step of grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
[Claim 18] 

The computer-readable recording medium according to claim 16 
or 17, characterized in that said audio feature detection step 
detects an audio fade-in. 
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[Claim 19] 

The computer- readable recording medium according to claim 16 
or 17, characterized in that said audio feature detection step 
detects a sudden increase in the audio level. 
[Claim 203 

The computer-readable recording medium according to any one 
of claims 13 to 19, characterized in that said priority setting 
step comprises: 

a beginning position setting step of setting a position in a 
scene to be a beginning point of a part adopted as a digest; and 

a continuous section setting step of setting a duration time 
period from the beginning position. 
[Claim 21] 

The computer-readable recording medium according to any one 
of claims 13 to 20, characterized by comprising a set 
information output step of structuring and outputting a result 
of associating pointer information to the moving image input in 
said moving image input step and priority information set in 
said priority setting step with scene information stored in the 
image segmentation step. 
[Claim 22] 

A computer-readable recording medium characterized by 
comprising : 

a set value reading step of reading set information set in 
said set information output step of the computer-readable 
recording medium according to claim 21; 
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a moving-image-to-reproduce input step of reading a moving 
image based on pointer information to the moving image described 
in the set information; 

a priority-to-reproduce setting step of setting a priority 
of scene of interest to reproduce; and 

a digest reproducing step of reproducing a digest based on 
priority information read, the moving image, and the reproducing 
priority set in the priority-to-reproduce setting step. 
[Claim 23] 

The computer-readable recording medium according to claim 21, 
characterized in that said set information output step 
comprises : 

a reproducing limitation priority setting step of setting 
the minimum value of priority that is allowed to be reproduced; 
and 

a minimum priority unlock key setting step of setting a key 
for unlocking the minimum priority. 
[Claim 24] 

A computer-readable recording medium characterized by 
comprising : 

a set value reading step of reading set information set in 
said set information output step of the computer-readable 
recording medium according to claim 23; 

a moving-image-to-reproduce input step of reading a moving 
image based on pointer information to the moving image described 
in the set information; 

a limited reproducing priority setting step of setting a 
priority of scene of interest to reproduce unable to be set 



equal to or lower than the reproducing limitation priority set 
in said reproducing limitation priority setting step of the 
computer-readable recording medium according to claim 23; 

a limit unlocking step of unlocking the limit on the 
reproducing limitation priority by specifying the minimum 
priority unlock key set in said minimum priority unlock key 
setting step of the computer-readable recording medium according 
to claim 23; and 

a digest reproducing step of reproducing a digest based on 
priority information read, the moving image, said limited 
reproducing priority setting step, and the reproducing priority 
set . 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to a moving image digest 
apparatus, computer-readable recording medium recording a moving 
image digest generating program, moving image reproducing 
apparatus, and computer-readable recording medium recording a 
moving image reproducing program. 

[0002] 

[Conventional Art] 

As networks have been getting faster and moving image 
distribution technologies over Internet have been getting 
advanced, moving image distribution has become popular. On the 
contrary, significant time and resources are still required to 
distribute a moving image; therefore, an apparatus capable of 
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finding a desired moving image without requiring a user to scan 
through the content of the moving image is needed. In order to 
solve the problem, there have been employed techniques for 
having a user determine whether a moving image is necessary for 
the user or not by showing the user a part of a long story of 
the moving image with a digest video which summarizes the 
content of the moving image. 
[0003] 

Conventionally, in order to generate a digest of a moving 
image with a computer system, the moving image has to be edited 
by using video editing software. Video editing programs include 
'Premiere' (Registered Trademark) from Adobe Systems 
Incorporated (Registered Trademark), for example. With 
'Premiere', a user can edit a moving image by importing a video 
file, manually cutting out and combining necessary scenes. 
Accordingly, the user can generate a digest by cutting out and 
combining parts which should comprise the digest. 
[0004] 

As a technique for generating a digest of a moving image, 
Japanese Patent Application Laid-Open No, H03-90968 discloses a 
technique for generating a moving image digest for a digest time 
period based on priorities set for respective scenes and an 
optionally-set digest time period. Japanese Patent Application 
Laid-Open No. H10-112835 discloses a technique for generating a 
digest by grouping scenes according to their similarities and 
combining representative image scenes of respective groups. 
[0005] 
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Japanese Patent Application Laid-Open No. H09-284704 
discloses a technique for automatically generating a digest 
(moving image digest) by extracting scenes which have audio 
signals of higher level as highlight seats. Japanese Patent 
Application Laid-open No. 09-284698 discloses a technique for 
generating a digest by combining representative scenes which are 
at shot breaks in a moving image. 
[0006] 

[Problems to be Solved by the Invention] 

Such a method as 'Premiere' requires a user to locate scenes 
to adopt by viewing a moving image from the beginning to the end 
or using a display window which displays frame images at a 
certain space in the film strip form, accordingly, requires a 
user to locate the scenes to adopt frame by frame in the end; 
therefore, once the user has generated a video clip to make a 
digest, the user has to remake a digest from scratch in order to 
generate a digest image of another length, which means the 
method is incapable of generating a highly flexible digest 
images answering the purpose. 
[0007] 

The digest image generation disclosed by Japanese Patent 
Application Laid-open No. HG3-90968 can generate a digest image 
which is made of scenes of high priorities for an optionally-set 
digest time period based on priorities set for respective 
scenes; though, in the case of a moving image of a long story or 
lots of topics, unless priorities are thoroughly and 
appropriately set throughout the moving image, a digest image of 
a biased content is generated and a high quality digest image 



which allows the user to properly grasp the entire moving image 

cannot be generated. 

[0008] 

In contrast, the techniques disclosed by Japanese Patent 
Application Laid-Open No. H10-112835 and Japanese Patent 
Application Laid-Open No. H10-284704 generates a digest by 
grouping scenes according to their similarities and combining 
representative image scenes of respective groups, and generates 
a digest by extracting scenes which have audio signals of higher 
level as highlight seats, respectively, so that the techniques 
are capable of somewhat generating a digest image which allows 
the user to grasp the entire moving image; though, in order to 
generate a digest image of another length, the user has to 
remake a digest from scratch, which means the techniques are 
incapable of generating highly flexible digest images answering 
the purposes. Even the technique disclosed by Japanese Patent 
Application Laid-Open No. H09-284698 is incapable of generating 
a highly flexible digest image answering the purpose either. 
[0009] 

The present invention is adapted to solve the above- 
mentioned problem and an object of the present invention is to 
provide a moving image digest apparatus and computer-readable 
recording medium recording a moving image digest generating 
program which correctly generate a digest image that allows the 
user to properly grasp the entire moving image and has high 
flexibility answering the purposes without generating a digest 
image with a biased content, and a moving image reproducing 
apparatus and computer-readable recording medium recording a 
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moving image reproducing program which reproduce a moving image 

digest with high flexibility answering the purpose. 

[0010] 

[Means for Solving the Problems] 

In order to achieve the above-mentioned objects, the moving 
image digest apparatus according to the present invention 
includes: a moving image input means for inputting a moving 
image; an scene segmentation means for segmenting the moving 
image input by the moving image input means for each scene; a 
group generation means for grouping the scenes resulting from 
the segmentation by the scene segmentation means; a priority 
setting means for setting a priority of the scene based on the 
result of grouping by the group generation means; and a digest 
output means for generating a digest moving image by selecting 
the scenes based on priority information set by the priority 
setting means. 

[00113 

The moving image digest apparatus according to the next 
invention is such that the priority setting means sets the 
highest priority to the first scene of the group. 
[0012] 

The moving image digest apparatus according to the next 
invention is such that the group generation means includes: a 
title determining means for determining whether title text is 
included in an image in the vicinity of the beginning position 
of a scene or not; a topic switch point setting means for 
setting a scene segmentation point which is determined to 
include the title text from the result of the title determining 
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means as a topic switch point; and an automatic grouping means 
for grouping a scene or scenes sandwiched between the topic 
switch points next to each other as a group. 
[0013] 

The moving image digest apparatus according to the next 
invention is such that the group generation means includes: an 
audio feature detection means for detecting an audio feature in 
the vicinity of a scene segmentation point; a topic switch point 
setting means for setting a scene segmentation point which is 
determined to include the audio feature from the result of the 
audio feature detection means as a topic switch point; and an 
automatic grouping means for grouping a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group. 
[0014] 

The moving image digest apparatus according to the next 
invention is such that the group generation means includes: a 
title determining means for determining whether title text is 
included in an image in the vicinity of the beginning position 
of a scene or not; an audio feature detection means for 
detecting an audio feature in the vicinity of a scene 
segmentation point; a topic switch point setting means for 
setting a scene segmentation point which is determined to 
include the title text by the title determining means and also 
determined to include a change in the audio feature by the audio 
feature detection means as a topic switch point; and an 
automatic grouping means for grouping a scene or scenes 
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sandwiched between the topic switch points next to each other as 
a group. 

[0015] 

The moving image digest apparatus according to the next 
invention is such that the audio feature detection means detects 
an audio fade-in. 
[0016] 

The moving image digest apparatus according to the next 
invention is such that the audio feature detection means detects 
a sudden increase in the audio level. 
[0017] 

The moving image digest apparatus according to the next 
invention is such that the priority setting means includes: a 
beginning position setting means for setting a position in a 
scene to be a beginning point of a part adopted as a digest; and 
a continuous section setting means for setting a duration time 
period from the beginning position. 
[0018] 

The moving image digest apparatus according to the next 
invention further includes a set information output means for 
structuring and outputting a result of associating pointer 
information to the moving image input by the moving image input 
means and priority information set by the priority setting means 
with scene information stored by the scene segmentation means. 
[0019] 

In order to achieve the above-mentioned objects, the moving 
image reproducing apparatus according to the present invention 
includes: a set value reading means for reading set information 
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set by the set information output means of the moving image 
digest apparatus according to the above-mentioned invention; a 
moving-image-to-reproduce input means for reading a moving image 
based on pointer information to the moving image described in 
the set information; a priority- to-reproduce setting means for 
setting a priority of scene of interest to reproduce; and a 
digest reproducing means for reproducing a digest based on 
priority information read, the moving image, and the reproducing 
priority set by the priority-to-reproduce setting means. 
[0020] 

The moving image digest apparatus according to the next 
invention is such that the set information output means 
includes: a reproducing limitation priority setting means for 
setting the minimum value of priority that is allowed to be 
reproduced; and a minimum priority unlock key setting means for 
setting a key for unlocking the minimum priority. 
[0021] 

The moving image reproducing apparatus according to the next 
invention includes: a set value reading means for reading set 
information set by the set information output means of the 
moving image digest apparatus according to the above-mentioned 
invention; a moving-image-to-reproduce input means for reading a 
moving image based on pointer information to the moving image 
described in the set information; a limited reproducing priority 
setting means for setting a priority of scene of interest to 
reproduce unable to be set egual to or lower than the 
reproducing limitation priority set by the reproducing 
limitation priority setting means of the moving image digest 
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apparatus according to the above-mentioned invention; a limit 
unlocking means for unlocking the limit on the reproducing 
limitation priority by specifying the minimum priority unlock 
key set by the minimum priority unlock key setting means of the 
moving image digest apparatus according to the above-mentioned 
invention; and a digest reproducing means for reproducing a 
digest based on priority information read, the moving image, the 
limited reproducing priority setting means, and the reproducing 
priority set. 
[0022] 

In order to achieve the above-mentioned objects, the 
computer-readable recording medium recording the moving image 
digest generating program according to the present invention 
records a program for causing a computer to execute: a moving 
image input step of inputting a moving image; an image 
segmentation step of segmenting the moving image input in the 
moving image input step for each scene; a group generation step 
of grouping the scenes resulting from the segmentation in the 
image segmentation step; a priority setting step of setting a 
priority of the scene based on the result of grouping in the 
group generation step; and a digest output step of generating a 
digest moving image by selecting the scenes based on priority 
information set in the priority setting step. 
[0023] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the priority setting step sets the highest priority 
to the first scene of the group. 



[0024] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the group generation step includes: a title 
determining step of determining whether title text is included 
in an image in the vicinity of the beginning position of a scene 
or not; a topic switch point setting step of setting a scene 
segmentation point which is determined to include the title text 
from the result of the title determining step as a topic switch 
point; and an automatic grouping step of grouping a scene or 
scenes sandwiched between the topic switch points next to each 
other as a group. 
[0025] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the group generation step includes: an audio 
feature detection step of detecting an audio feature in the 
vicinity of a scene segmentation point; a topic switch point 
setting step of setting a scene segmentation point which is 
determined to include the audio feature from the result of the 
audio feature detection step as a topic switch point; and an 
automatic grouping step of grouping a scene or scenes sandwiched 
between the topic switch points next to each other as a group. 
[0026] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the group generation step includes: a title 
determining step of determining whether title text is included 
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in an image in the vicinity of the beginning position of a scene 
or not; an audio feature detection step of detecting an audio 
feature in the vicinity of a scene segmentation point; a topic 
switch point setting step of setting a scene segmentation point 
which is determined to include the title text in the title 
determining step and also determined to include a change in the 
audio feature in the audio feature detection step as a topic 
switch point; and an automatic grouping step of grouping a scene 
or scenes sandwiched between the topic switch points next to 
each other as a group. 
[0027] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the audio feature detection step detects an audio 
fade-in . 
[0028] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the audio feature detection step detects a sudden 
increase in the audio level. 
[0029] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the priority setting step includes: a beginning 
position setting step of setting a position in a scene to be a 
beginning point of a part adopted as a digest; and a continuous 
section setting step of setting a duration time period from the 
beginning position. 



[0030] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
includes: a set information output step of structuring and 
outputting a result of associating pointer information to the 
moving image input in the moving image input step and priority 
information set in the priority setting step with scene 
information stored in the image segmentation step. 
[0031] 

In order to achieve the above-mentioned objects, the 
computer-readable recording medium recording the moving image 
reproducing program according to the present invention is the 
computer-readable recording medium recording the moving image 
digest generating program including: a set value reading step of 
reading set information set in the set information output step 
of the computer-readable recording medium according to the 
above-mentioned invention; a moving~image-to-reproduce input 
step of reading a moving image based on pointer information to 
the moving image described in the set information; a priority- 
to-reproduce setting step of setting a priority of scene of 
interest to reproduce; and a digest reproducing step of 
reproducing a digest based on priority information read, the 
moving image, and the reproducing priority set in the priority- 
to-reproduce setting step. 
[0032] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
is such that the set information output step includes: a 
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reproducing limitation priority setting step of setting the 
minimum value of priority that is allowed to be reproduced; and 
a minimum priority unlock key setting step of setting a key for 
unlocking the minimum priority. 
[0033] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
includes: a set value reading step of reading set information 
set in the set information output step of the computer-readable 
recording medium according to the above-mentioned invention; a 
moving-image-to-reproduce input step of reading a moving image 
based on pointer information to the moving image described in 
the set information; a limited reproducing priority setting step 
of setting a priority of scene of interest to reproduce unable 
to be set equal to or lower than the reproducing limitation 
priority set in the reproducing limitation priority setting step 
of the computer-readable recording medium according to the 
above-mentioned invention; a limit unlocking step of unlocking 
the limit on the reproducing limitation priority by specifying 
the minimum priority unlock key set in the minimum priority 
unlock key setting step of the computer-readable recording 
medium according to the above-mentioned invention; and a digest 
reproducing step of reproducing a digest based on priority 
information read, the moving image, the limited reproducing 
priority setting step, and the reproducing priority set. 



[0034] 

[Embodiments of the Invention] 

Embodiments of a moving image digest apparatus, computer- 
readable recording medium recording a moving image digest 
generating program, moving image reproducing apparatus, and 
computer-readable recording medium recording a moving image 
reproducing program according to the present invention will be 
described in detail below with reference to the accompanying 
drawings . 

[0035] 

Embodiment 1. Figure 1 shows an embodiment 1 of the moving 
image digest apparatus according to the present invention. The 
moving image digest generating apparatus includes a moving image 
input means 1 for inputting and storing a moving image from 
various external media; an scene segmentation means 3 for 
detecting a shot break in the moving image input by the moving 
image input means 1 and storing the information; a group 
generation means 5 for grouping a plurality of scenes as a 
group; a priority setting means 7 for setting a priority to a 
scene based on the result of the grouping; and a digest output 
means 9 for cutting out parts from a moving image stored in the 
moving image input means 1 according to an optionally-set output 
priority and a priority set by the priority setting means' 7, 
combining the parts and outputting the combined result as a 
digest moving image. 
[0036] 

Figure 2 shows an example of a screen display of the moving 
image digest apparatus according to the present invention. In 



the screen display, reference numeral 100 denotes a moving image 
display part, 102 denotes a moving image structure display part, 
104 denotes a representative image display frame, 106 denotes a 
slide bar, 108 denotes a moving image manipulation part, and 110 
denotes a function select menu part. 
[0037] 

It is assumed that the moving image is saved in the hard 
disk of the computer. A moving image is read from the hard disk 
through the moving image input means 1. The moving image read is 
subjected to detection of shot break such as a change of camera 
view by the scene segmentation means 3 manually or automatically. 
Information obtained on the shot break is stored by the scene 
segmentation means 3 as image segmentation data in the form of 
frame number, time, time code, and the like which identify the 
position of the shot break. 
[0038] 

Figure 3 shows an example of scene information stored in the 
scene segmentation means 3 as a result of image segmentation. In 
this example, it is assumed that the frame information is used 
as position identification information. Figure 4 shows an 
example of the content displayed on the moving image structure 
display part 102 after the image segmentation. A root 201 
indicates the entire moving image, and representative images 202 
to 211 are frame images at the scene segmentation points from 
the scene 1 to the scene 10 cut out as still images, 
respectively . 



- 25 - 



[0039] 

Then, the scenes are grouped according to the content of the 
moving image or the like by the group generation means 5 as 
shown in Figure 5. For the representative image 212 representing 
the group 1, a still image of the beginning frame of the group 
is displayed. Based on the grouped result, the priority setting 
means 7 sets priorities of the scenes. It is assumed that the 
priority can be specified between 0 and 255 with 0 the highest 
and 255 the lowest, here. 
[0040] 

For the groups of scenes, it can be set to always use 
specified number of scenes extracted from each group. For 
example, when it is specified to select two scenes from a group, 
0 (the highest priority) is assigned to the priority of the 
scenes at frame interval of the number of scenes of a group 
divided by two. For groups generated as shown in Figure 5, when 
the number of scenes to be adopted as a digest for each group is 
two, the highest priority 0 is set to the scenes 1, 3, 6, 8, 9, 
and 10. 
[0041] 

By setting the highest priority to the first scene of a 
group so as to be adopted as a digest, scenes can be selected 
uniformly throughout the story from a group generated according 
to the story. For example, the highest priority 0 is assigned to 
the scenes 1, 6, and 9 in the scenes grouped as shown in Figure 
5. 
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[0042] 

Based on the priorities set as mentioned above, the digest 
output means 9 generates a digest with the output priority 
specified by selecting scenes according to the priorities set to 
the scenes. 
[0043] 

When priorities are set as shown in Figure 6 and the output 
priority is 0, the scenes 1, 6, and 9 are the scenes to make the 
digest moving image; then they are cut out from the moving image 
231 stored in the moving image input means 1 and combined 
together to make the digest moving image 232 as shown in Figure 
7 . 

[0044] 

The system of the moving image digest apparatus can be 
expanded as below: 
(1) Automating group generation 

Most of such videos as an educational video are structured 
to describe a matter with a plurality of topics. For such videos, 
a digest needs to be generated covering all the topics without 
exception . 
[0045] 

The above-mentioned grouping can be performed manually; 
though, if the topic switch points where the topic switches are 
automatically detected and the scene or scenes sandwiched 
between the topic switch points are automatically grouped, a 
digest can be generated covering all the topics without 
exception by requiring no human intervention. In order to 
realize this, the system should be expanded as below. 
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[0046] 

Figure 8 shows the group generation means 5 with an 
automated grouping function. The group generation means 5 
includes a title determining means 11 for determining whether 
the frame images from the scene segmentation point to a certain 
frame includes title text or not; an audio feature detection 
means 13 for detecting audio information in the vicinity of the 
scene segmentation point; a topic switch point setting means 15 
for storing the time point as a topic switch point when a scene 
segmentation point includes title text and the audio feature 
shows a fade-in in the vicinity of the scene change or an audio 
level increase at a time of scene change; and an automatic 
grouping means 17 for grouping the scenes by automatically 
determining scenes from the beginning to a topic switch point, 
from a topic switch point to another topic switch point, or a 
topic switch point to the end as a group. 
[0047] 

Determination of presence/absence of title text can be 
performed in various manners by the title determining means 11. 
For example, as title text has a feature of high brightness, it 
can be determined that a scene including a region which has high 
density of high brightness parts is a title image. In the audio 
feature detection by the audio feature detection means 13, a 
fade-in in the vicinity of the scene segmentation point or a 
sudden increase in the music level almost at a time of the scene 
segmentation point is detected. 



[0048] 

Whether it is a fade-in or not can also be determined by 
several manners. Here, it is assumed that the manner shown below 
is taken. Consider a case where the scene has the audio level 
shown in Figure 9 around the scene segmentation point. Peak 
audio level Pn is obtained at each section dt from the time t-At. 
Where the audio level peak at time t-At is PI and the audio 
level peak at time t-At + dt is P2, whether the relationship 
between Pi and P2 is P2 > PI or not is determined. Here, with an 
audio increase table shown in Figure 10 prepared, a section 
which fulfills P(t+dt)>P(t) is marked. If all the sections are 
marked, it is determined as a fade-in. 
[0049] 

Whether the music level suddenly increases almost at a time 
of the beginning of the scene or not also is determined by 
several manners; and here, a determination manner is described 
by assuming a case where the scene has the audio level shown in 
Figure 11. Audio level peaks are obtained for a certain section 
t + At from the scene segmentation point time t, and compared 
with the audio level peak at time t - dt which is a little 
section dt before the scene segmentation point time t. If the 
audio level peak at the time t - dt is lower than the threshold 
Tn and the audio level over the threshold Th lasts for a period 
t + At from the scene segmentation point time t, it is 
determined as a sudden increase in the audio level. 
[0050] 

With the above-mentioned determination manners, 
presence/absence of the title and the audio feature can be 
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determined. Those kinds of information can be used individually 
or in combination. If those kinds of information are used 
individually, the scene segmentation point which is determined 
to include title, to have the audio feature of fade-in, or to 
have the audio feature of sudden increase in the audio level is 
respectively determined as the topic switch point by the topic 
switch point detecting means 15. If those kinds of information 
are used in combination, the scene segmentation point which is 
determined to include title and also determined to have the 
audio feature of fade-in or sudden increase is determined as the 
topic switch point. Further, the automatic grouping means 17 
performs automatic grouping processing to automatically group 
the scenes for each topic. 
[0051] 

Automating the group generation in the above-mentioned 
manner can save labor in generating the digest. With the 
function performed, the result of image segmentation is grouped 
automatically. 
[0052] 

(2) Limitation on the range of scenes to be adopted to digest 
As shown in Figure 12, to the priority setting means 7, a 
beginning position setting means 21 for setting a part of the 
image of interest or the group of interest to be adopted in 
generating the digest; and a continuous section setting means 23 
for setting the length of the image or the group to be adopted 
as the digest can be added. 
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[0053] 

That enables only a partial adoption of the scene or the 
group as the digest image, which realizes flexible digest 
generation. If priority is set with a certain scene or group 
selected, a priority/section setting dialog is displayed on the 
screen as shown in Figure 13. The values specified in the 
beginning position specifying field and the duration time period 
specifying field in the dialog are stored in the priority 
setting means 7, and the part set here is cut out and used in 
generating the digest. As a result, as shown in Figure 14, a 
part of each scene is cut out and adopted as the digest. 
[0054] 

If the time period to output the digest is limited, the 
system expansion enables the time period to be evenly 
distributed to respective scenes which only requires the result 
of the set time divided by the number of scenes to be set to the 
duration time period. 
[0055] 

(3) Saving the set values in the external storage and using them 
in the client 

As shown in Figure 15, to the moving image input means 1, 
the scene segmentation means 3, the group generation means 5, 
the priority setting means 7, and the digest output means 9, a 
set information output means 31 for storing set information such 
as image segmentation information, priority set information, 
pointers to the moving image, and the like into an external 
medium can be added. 



[0056} 

In this embodiment, it is assumed that the set information 
output means 31 outputs a digital file. By outputting the set 
information, instead of the moving image file itself in 
generating a digest, and making another machine read a digital 
file containing the set information by using the same moving 
image digest apparatus over network connection or the like, the 
third party can set reproducing priority even after the digest 
is generated. 
[0057] 

If the digital file has a group structure as shown in Figure 
5 with each scene having a priority set as shown in Figure 6, 
information is saved in the form of the path to the moving image 
file and packed information on respective scenes coupled 
together as shown in Figure 16. In the example, as the path to 
the moving image is common to all the scenes, it is defined as 
the header part. 
[0058] 

For the reproduction environment in this case, a reproducing 
apparatus including a set value reading means 41, a moving- 
image~to-reproduce input means 43, a priority-to-reproduce 
setting means 45, and a digest reproducing means 47 as shown in 
Figure 17 can be used. In this case, the set value is read from 
a file in the form as shown in Figure 16 by the set value 
reading means 41, the moving image file which has written in the 
set information is opened through the moving-image-to-reproduce 
input means 43, the content is expanded, and the digest is 
reproduced by the digest reproducing means 47 with the 
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reproducing priority set by the priority-to-reproduce setting 
means 45. 
[0059] 

Figure 18 shows an example of the screen of the reproducing 
apparatus. The screen as the reproduction environment includes a 
function selection menu 120, a digest display region 122, and a 
moving image manipulation part 124. When reproduction is 
instructed at the moving image manipulation part 124, the digest 
reproducing means 47 determines the priority of each scene and 
reproduces the digest. If the reproducing priority is set to 1, 
the scenes 1, 3, 6, 8, 9, and 10 are reproduced in order. If the 
reproducing priority is set to 0, only the scenes 1, 6, and 9 
are reproduced. By changing the reproducing priority like that, 
the details of the digest content can be changed according to 
the circumstances. 
[0060] 

(4) Lock to the content by setting reproducing priority that is 
allowed to be reproduced 

As shown in Figure 19, with a reproducing limitation 
priority setting means 33 provided for the set information 
output means 31, and by writing the reproducing limitation 
priority into the set information at a time when the digest is 
generated, the reproduction environment can be made to set a 
certain priority or more. At the same time, with a minimum 
priority unlock key setting means 35 for setting a key for 
unlocking the limit (the reproducing limitation priority) 
provided for the set information output means 31, and by 
specifying the key, the limit can be unlocked. 
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[0061] 

As shown in Figure 20, to the reproducing apparatus, a 
limited reproducing priority setting means 49 for setting a 
priority of a scene of interest to reproduce unable to be set 
equal to or lower than the reproducing limitation priority set 
by the reproducing limitation priority setting means 33 and a 
limit unlocking means 51 for unlocking the limit by reading the 
key are added so that the limit on the reproduction can be 
unlocked by key input (password input) . 
[0062] 

As the file structure shown in Figure 21, the reproducing 
limitation priority and the key are written as members of the 
header part. That enables a use of video on demand application 
such that a customer is limited to watch just a part of the 
digest in the ordinary state (before charged) , but once the 
customer is charged, the customer receives a key to allow the 
customer to watch all the scenes. For example, as shown in 
Figure 21, if the scene structure and priority are specified and 
the reproducing limitation priority is 0, only the scenes 1 and 
4 are available. When the lock on the reproducing limitation 
priority is unlocked with the key received after the customer is 
charged, the customer is allowed to watch all the details of the 
video with the contents file left the same. 
[0063] 

With the above-mentioned embodiment, the digest of a moving 
image can be generated easier than before. Besides, by flexibly 
setting the reproducing priority, the digest can be reproduced 
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within, a range to suit the user's needs or the intention of the 

content provider. 

[0064] 

[Advantages of the Invention] 

As understood from the above-mentioned description, the 
moving image digest apparatus according to the present invention 
generates the digest moving image by grouping the scenes 
resulted from the segmentation, by deciding a priority of each 
scene based on the result of the grouping, and by selecting the 
scenes based on the optionally-set output priority and priority 
information; therefore, even in the case of a moving image of a 
long story or lots of topics, it can easily generate a digest 
image which provides the user with a grasp of the entire moving 
image and which also has high flexibility answering the purpose 
according to the setting of the output priority, without 
generating a digest image of a biased content. 
[0065] 

The moving image digest apparatus according to the next 
invention sets the highest priority to the first scene of the 
group; therefore, even in the case of a moving image of a long 
story or lots of topics, it can correctly generate a digest 
image which provides the user with a grasp of the entire moving 
image and which also has high flexibility answering the purpose 
according to the setting of the output priority, without 
generating a digest image of a biased content. 
[0066] 

The moving image digest apparatus according to the next 
invention sets a scene segmentation point which is determined to 



include the title text as a topic switch point, and 
automatically groups a scene or scenes sandwiched between the 
topic switch points next to each other as a group; therefore, it 
can automatically and correctly group the scene or scenes, and 
even in the case of a moving image of a long story or lots of 
topics, it can correctly generate a digest image which provides 
the user with a grasp of the entire moving image and which also 
has high flexibility answering the purpose, without generating a 
digest image of a biased content. 
[0067] 

The moving image digest apparatus according to the next 
invention sets a scene segmentation point which is determined to 
include the audio feature as a topic switch point, and 
automatically groups a scene or scenes sandwiched between the 
topic switch points „^ to each Qther as a group . therefore, it 
can automatically and correctly group the scent ~~ ~~ Qnes and 
even in the case of a moving image of a long story or lots of 
topics, it can correctly generate a digest image which provides 
the user with a grasp of the entire moving image and which also 
has high flexibility answering the purpose, without generating a 
digest image of a biased content, 
[0068] 

The moving image digest apparatus according to the next 
invention sets a scene segmentation ;point which is determined to 
include tine title fcesiit and also dtetearmined to include a change 
in the amdi© ifeattauire as a topic .SiWiLttech point, and automatically 
groups a .sceime mc .scoeaases saimdlwitdked between the topic switch 
points .next it® eacl i \ i as a group; therefore, it can 



automatically and correctly group the scene or scenes, and even 
in the case of a moving image of a long story or lots of topics, 
it can correctly generate a digest image which provides the user 
with a grasp of the entire moving image and which also has high 
flexibility answering the purpose, without generating a digest 
image of a biased content. 
[0069] 

The moving image digest apparatus according to the next 
invention sets a topic switch point by detecting an audio fade- 
in, and automatically groups a scene or scenes sandwiched 
between the topic switch points next to each other as a group; 
therefore, it can automatically and correctly group the scene or 
scenes, and even in the case of a moving image of a long story 
or lots of topics, it can correctly generate a digest image 
which provides the user with a grasp of the entire moving image 
and which also has high flexibility answering the purpose, 
without generating a digest image of a biased content. 
[0070] 

The moving image digest apparatus according to the next 
invention sets a topic switch point by detecting a sudden 
increase in the audio level, and automatically groups a scene or 
scenes sandwiched between the topic switch points next to each 
other as a group; therefore, it can automatically and correctly 
group the scene or scenes, and even in the case of a moving 
image of a long story or lots of topics, it can correctly 
generate a digest image which provides the user with a grasp of 
the entire moving image and which also has high flexibility 
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answering the purpose, without generating a digest image of a 

biased content. 

[0071] 

The moving image digest apparatus according to the next 
invention sets a position in a scene to be a beginning point of 
a part adopted as a digest, and generates a digest image for the 
duration time period set from the beginning position; therefore, 
it can extract only a part of the scene to be adopted as a 
digest and adopt the part, and it can correctly generate a 
digest image which answers the purpose but is not lengthy. 
[0072] 

The moving image digest apparatus according to the next 
invention structures the result of associating pointer 
information to the moving image input and priority information 
with scene information and outputs it; therefore, it can 
flexibly provide the user with a digest answering the purpose at 
the reproducing side. 
[0073] 

The moving image reproducing apparatus according to the next 
invention reproduces a digest based on priority information read, 
the moving image, and the reproducing priority set by the 
priority-to-reproduce setting means; therefore, it can flexibly 
provide the user with a digest answering the purpose according 
to the reproducing priority. 
[0074] 

The moving image digest apparatus according to the next 
invention sets the minimum value of priority that is allowed to 
be reproduced and a key for unlocking the minimum priority so 
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that it sets a priority of scene of interest to reproduce unable 
to be set equal to or lower than the reproducing limitation 
priority but it unlocks the limit when the minimum priority 
unlock key is specified; therefore, it allows detailed 
information of the content to be optionally locked at the 
reproducing side. 
[0075] 

The moving image reproducing apparatus according to the next 
invention has the minimum value of priority that is allowed to 
be reproduced and a key for unlocking the minimum priority set, 
and sets a priority of scene of interest to reproduce unable to 
be set equal to or lower than the reproducing limitation 
priority but unlocks the limit when the minimum priority unlock 
key is specified; therefore, it allows detailed information of 
the content to be optionally locked and can reproduce a digest 
within a range to suit the user's needs or the intention of the 
content provider. 
[0076] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
generates the digest moving image by grouping the scenes 
resulted from the segmentation, by deciding a priority of each 
scene based on the result of the grouping, and by selecting the 
scenes based on the optionally-set output priority and priority 
information; therefore, even in the case of a moving image of a 
long story or lots of topics, it can easily generate a digest 
image which provides the user with a grasp of the entire moving 
image and which also has high flexibility answering the purpose 
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according to the setting of the output priority, without 

generating a digest image of a biased content. 

[0077] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets the highest priority to the first scene of the group; 
therefore, even in the case of a moving image of a long story or 
lots of topics, it can correctly generate a digest image which 
provides the user with a grasp of the entire moving image and 
which also has high flexibility answering the purpose according 
to the setting of the output priority, without generating a 
digest image of a biased content. 
[0078] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets a scene segmentation point which is determined to include 
the title text as a topic switch point, and automatically groups 
a scene or scenes sandwiched between the topic switch points 
next to each other as a group; therefore, it can automatically 
and correctly group the scene or scenes, and even in the case of 
a moving image of a long story or lots of topics, it can 
correctly generate a digest image which provides the user with a 
grasp of the entire moving image and which also has high 
flexibility answering the purpose, without generating a digest 
image of a biased content. 
[0079] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
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sets a scene segmentation point which is determined to include 
the audio feature as a topic switch point, ' and automatically 
groups a scene or scenes sandwiched between the topic switch 
points next to each other as a group; therefore, it can 
automatically and correctly group the scene or scenes, and even 
in the case of a moving image of a long story or lots of topics, 
it can correctly generate a digest image which provides the user 
with a grasp of the entire moving image and which also has high 
flexibility answering the purpose, without generating a digest 
image of a biased content. 
[0080] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets a scene segmentation point which is determined to include 
the title text and also determined to include a change in the 
audio feature as a topic switch point, and automatically groups 
a scene or scenes sandwiched between the topic switch points 
next to each other as a group; therefore, it can automatically 
and correctly group the scene or scenes, and even in the case of 
a moving image of a long story or lots of topics, it can 
correctly generate a digest image which provides the user with a 
grasp of the entire moving image and which also has high 
flexibility answering the purpose, without generating a digest 
image of a biased content. 
[0081] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets a topic switch point by detecting an audio fade-in, and 
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automatically groups a scene or scenes sandwiched between the 
topic switch points next to each other as a group; therefore, it 
can automatically and correctly group the scene or scenes, and 
even in the case of a moving image of a long story or lots of 
topics, it can correctly generate a digest image which provides 
the user with a grasp of the entire moving image and which also 
has high flexibility answering the purpose, without generating a 
digest image of a biased content. 
[0082] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets a topic switch point by detecting a sudden increase in the 
audio level, and automatically groups a scene or scenes 
sandwiched between the topic switch points next to each other as 
a group; therefore, it can automatically and correctly group the 
scene or scenes, and even in the case of a moving image of a 
long story or lots of topics, it can correctly generate a digest 
image which provides the user with a grasp of the entire moving 
image and which also has high flexibility answering the purpose, 
without generating a digest image of a biased content. 
[0083] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets a position in a scene to be a beginning point of a part 
adopted as a digest, and generates a digest image for the 
duration (time period) set from the beginning position; 
therefore, it can extract only a part of the scene to be adopted 
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as a digest and adopt the part, and it can correctly generate a 
digest image which answers the purpose but is not lengthy. 
[0084] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
structures the result of associating pointer information to the 
moving image input and priority information with scene 
information and outputs it; therefore, it can flexibly provide 
the user with a digest answering the purpose at the reproducing 
side . 
[0085] 

The computer-readable recording medium recording the moving 
image reproducing program according to the next invention 
reproduces a digest based on priority information read, the 
moving image, and the reproducing priority set by the priority- 
to-reproduce setting means; therefore, it can flexibly provide 
the user with a digest answering the purpose according to the 
reproducing priority. 
[0086] 

The computer-readable recording medium recording the moving 
image digest generating program according to the next invention 
sets the minimum value of priority that is allowed to be 
reproduced and a key for unlocking the minimum priority so that 
it sets a priority of scene of interest to reproduce unable to 
be set equal to or lower than the reproducing limitation 
priority but it unlocks the limit when the minimum priority 
unlock key is specified; therefore, it allows detailed 
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information of the content to be optionally locked at the 

reproducing side. 

[0087] 

The computer-readable recording medium recording the moving 
image reproducing program according to the next invention sets 
the minimum value of priority that is allowed to be reproduced 
and a key for unlocking the minimum priority, and it sets a 
priority of scene of interest to reproduce unable to be set 
equal to or lower than the reproducing limitation priority but 
unlocks the limit when the minimum priority unlock key is 
specified; therefore, it allows detailed information of the 
content to be optionally locked and can reproduce a digest 
within a range to suit the user's needs or the intention of the 
content provider. 

[Brief Description of the Drawings] 
[Figure 1] 

Figure 1 is a block diagram showing an embodiment 1 of a 
moving image digest apparatus according to the present invention. 
[Figure 2] 

Figure 2 is an illustration showing an example of a screen 
display of the moving image digest apparatus according to the 
present invention. 
[Figure 3] 

Figure 3 is a table showing image segmentation data used by 
the moving image digest apparatus according to the present 
invention . 
[Figure 4] 

_ 44 _ 



Figure 4 is a schematic diagram showing an example of 
displaying a result of image segmentation on a moving image 
display part of the moving image digest apparatus according to 
the present invention. 
[Figure 5] 

Figure 5 is a schematic diagram showing an example of 
displaying a result of grouping on the moving image display part 
of the moving image digest apparatus according to the present 
invention . 
[Figure 6] 

Figure 6 is a table showing priorities set for scenes in the 
moving image digest apparatus according to the present invention. 
[Figure 7] 

Figure 7 is a schematic diagram for showing an example of 
digest generation performed in the moving image digest apparatus 
according to the present invention. 
[Figure 8] 

Figure 8 is a block diagram showing a configuration of a 
group generation means of the moving image digest apparatus 
according to the present invention. 
[Figure 9] 

Figure 9 is a waveform diagram showing an audio waveform in 
the vicinity of the scene segmentation point which is an example 
of audio fade-in determination performed by the moving image 
digest apparatus according to the present invention. 
[Figure 10] 
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Figure 10 is a diagram showing a determination table used in 
fade-in determination performed by the moving image digest 
apparatus according to the present invention. 
[Figure 11] 

Figure 11 is a waveform diagram showing an audio waveform in 
the vicinity of the scene segmentation point which takes an 
example of the case in which an audio level is suddenly 
increased almost at a time of the scene segmentation point in 
the moving image digest apparatus according to the present 
invention . 
[Figure 12] 

Figure 12 is a block diagram showing a priority setting 
means of the moving image digest apparatus according to the 
present invention. 
[Figure 13] 

Figure 13 is an illustration showing a priority set dialog 
of the moving image digest apparatus according to the present 
invention . 
[Figure 14] 

Figure 14 is a schematic diagram showing a result of digest 
generation performed on the scenes subjected to section setting 
in the moving image digest apparatus according to the present 
invention . 
[Figure 15] 

Figure 15 is a block diagram showing a configuration of a 
case where a set information output means is added to the moving 
image digest apparatus according to the present invention. 
[Figure 16] 
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Figure 16 is a schematic diagram showing an example of a 
data format output by the set information output means in the 
moving image digest apparatus according to the present invention. 
[Figure 17] 

Figure 17 is a block diagram showing an embodiment of the 
moving image reproducing apparatus according to the present 
invention . 
[Figure 18] 

Figure 18 is an illustration showing an example of a screen 
of the moving image reproducing apparatus according to the 
present invention. 
[Figure 19] 

Figure 19 is a block diagram showing another embodiment of 
the moving image digest apparatus according to the present 
invention . 
[Figure 20] 

Figure 20 is a block diagram showing another embodiment of 
the moving image reproducing apparatus according to the present 
invention . 
[Figure 21] 

Figure 21 is a schematic diagram showing an example of a 
data format output by the set information output means in the 
moving image digest apparatus according to the present invention. 

[Description of Symbols] 
1 moving image input means 
3 scene segmentation means 
5 group generation means 



7 priority setting means 

9 digest output means 

11 title determining means 

13 audio feature detection means 

15 topic switch point setting means 

17 automatic grouping means 

21 beginning position setting means 

23 continuous section setting means 

31 set information output means 

33 reproducing limitation priority setting means 

35 minimum priority unlock key setting means 

41 set value reading means 

43 moving-image-to-reproduce input means 

45 priority-to-reproduce setting means 

47 digest reproducing means 

49 limited reproducing priority setting means 

51 limit unlocking means 



Figure 1 

1 MOVING IMAGE INPUT MEANS 
3 SCENE SEGMENTATION MEANS 
5 GROUP GENERATION MEANS 
7 PRIORITY SETTING MEANS 
9 DIGEST OUTPUT MEANS 

Figure 3 

#1 SCENE ( v-> ) 

Figure 4 
#1 SCENE 

Figure 5 
#1 SCENE 

#2 GROUP ( 7)1 — 7 ) 
Figure 6 

#1 SCENE NAME ( 5> — ) 
#2 SCENE 

#3 PRIORITY ( ) 

Figure 7 
#1 GROUP 
#2 SCENE 
#3 PRIORITY 

#4 GENERATE DIGEST WITH OUTPUT PRIORITY >= 1 
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Figure 8 

5 GROUP GENERATION MEANS 

11 TITLE DETERMINING MEANS 

13 AUDIO FEATURE DETECTION MEANS 

15 TOPIC SWITCH POINT SETTING MEANS 

17 AUTOMATIC GROUPING MEANS 

Figure 10 

#1 SECTION ( EPbI ) 

#2 DETERMINATION ( Wfe ) 

Figure 12 

7 PRIORITY SETTING MEANS 

21 BEGINNING POSITION SETTING MEANS 

23 CONTINUOUS SECTION SETTING MEANS 

Figure 13 

#1 NAME OF SCENE, GROUP OF INTEREST: SCENE 3 ( ^t^V~ X V )V— 7* 
« ) 

#2 PRIORITY: 2 

#3 BEGINNING POSITION: FRAME 460 ( F?!&j{£S ) 
#4 DURATION TIME PERIOD: 30 FRAMES 

Figure 14 

#1 SECTIONS WITH SPECIFIED RANGES ( t&fflJa&£ ft £ KM ) 

#2 SCENE 
#3 PRIORITY 

#4 GENERATE DIGEST WITH OUTPUT PRIORITY >= 1 
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Figure 15 

1 MOVING IMAGE INPUT MEANS 

3 SCENE SEGMENTATION MEANS 

5 GROUP GENERATION MEANS 

7 PRIORITY SETTING MEANS 

9 DIGEST OUTPUT MEANS 

31 SET INFORMATION OUTPUT MEANS 

Figure 16 

#1 HEADER (A.y^f) 

#2 PATH TO MOVING IMAGE { SjU'V <DA°^ ) 

#3 DATA ( T 1 '— £ ) 

#4 SCENE NAME ( >/ — >^ ) 

#5 SCENE 

#6 BEGINNING POSITION 

#7 END POSITION 

#8 PRIORITY 

Figure 17 

41 SET VALUE READING MEANS 
43 MOVING -I MAGE -TO-RE PRODUCE INPUT MEANS 
45 PRIORITY-TO-REPRODUCE SETTING MEANS 
47 DIGEST REPRODUCING MEANS 

Figure 19 

1 MOVING IMAGE INPUT MEANS 
3 SCENE SEGMENTATION MEANS 



5 GROUP GENERATION MEANS 

7 PRIORITY SETTING MEANS 

9 DIGEST OUTPUT MEANS 

31 SET INFORMATION OUTPUT MEANS 

33 REPRODUCING LIMITATION PRIORITY SETTING MEANS 
35 MINIMUM PRIORITY UNLOCK KEY SETTING MEANS 

Figure 20 

41 SET VALUE READING MEANS 

43 MOVING-IMAGE-TO-RE PRODUCE INPUT MEANS 

49 LIMITED REPRODUCING PRIORITY SETTING MEANS 

51 LIMIT UNLOCKING MEANS 

47 DIGEST REPRODUCING MEANS 

Figure 21 

#1 HEADER 

#2 PATH TO MOVING IMAGE 

#3 REPRODUCING LIMITATION PRIORITY ( 5fclg ) 

#4 DATA 

#5 SCENE NAME 

#6 SCENE 

#7 BEGINNING POSITION 

#8 END POSITION 

#9 PRIORITY 
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Abstract of JP 2000312333 (A) 
PROBLEM TO BE SOLVED: To quickly edit an 
image by displaying a static image at a position 
having a distance equivalent to the difference 
between the time corresponding to a prescribed 
reference position set on a screen and the time of a 
scene. SOLUTION: An editing start image display 
window 183 displays an image of the start position 
of an image which is included in a prescribed AV 
contents and used after its editing, and an editing 
end image display window 184 displays an image of 
the end position of an image which is included in the 
prescribed AV contents and used after its editing. An 
editing image list display window 1 85 displays the 
name of the original AV contents, the start or end 
position, etc., of an image which is edited by an AV 
contents editing program and included in the 
generated AV contents.; An image display window 
171 displays a thumbnail image of the static image 
included in an AV contents static image data file 
which is actively displayed in a contents selection 
window 181 . 
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